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provide an estimate of an unknown parameter, but only an assessment
of whether an effect or difference is present in the population. The mere
recognition that such an assessment Is needed, that not all observed out-
comes signify a real underlying cause, already shows statistical sophis-
tication. Judges of science fair displays who talk to the able students
who have prepared them find that any effect In the desired direction,
however small, is regarded as convincing. The role of chance variation
is not recognized.

Statistical significance is a way of answering the question "Is the ob-
served effect larger than can reasonably be attributed to chance alone?"
Here is the reasoning of significance tests presented informally In the
setting of an important example:

During the Vietnam era, Congress decided that young men
should be chosen at random for service in the army. The first
draft lottery was held in 1970. Birth dates were drawn in ran-
dom order and men were drafted in the order in which their
birth dates were selected. After the drawing, news organiza-
tions claimed that men born late in the year were more likely
to get low draft numbers and so to be inducted. Data analysis
(Figure 10) does suggest an association between birth date and
draft number. A statistic that measures the strength of the as-
sociation between draft number (1 to 366) and birth date (I to
366 beginning with January 1) is the correlation coefficient. In
fact, r = -0.226 for the 1970 lottery. Is this good evidence that
the lottery was not truly random?

A significance test approaches the issue by asking a probability ques-
tion: Suppose for the sake of argument that the lottery were truly ran-
dom; what is the probability that a random lottery would produce an r
at least as far from 0 as the observed r = -0.226? Answer: The proba-
bility that a random lottery will produce an r this far from 0 is less than
0.001. Conclusion: Since an r as far from 0 as that observed in 1970
would almost never occur in a random lottery, we have strong evidence
that the 1970 lottery was not random.

Figure 10 displays the scatterplot of draft numbers assigned to each
birth date by the 1970 draft lottery. It is difficult to see any systematic
association between birth date and lottery number in the scatterplot.
Clever graphics can emphasize the association, as in the figure. But a
probability calculation is needed to learn whether the observed associa-
tion is larger than can reasonably be attributed to chance alone.

In a random assignment of draft numbers to birth dates, we would
expect the correlation to be close to 0. The observed correlation for the